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IMAGING SYSTEM AND METHOD 
FOR BODY CONDITION EVALUATION 



FIELD OF THE INVENTION 

The invention is generally in the field of monitoring techniques, and relates 
to a monitoring method and system for body condition evaluation, particularly 
useful for estimating the body condition score of animals, such as dany cows. 

5 BACKGROUND OF THE INVENTION 

Measuring a variety of attributes of animals, such as cows or beef cattle, is 
of high importance for farmers. Techniques aimed at determining animal traits, 
such as the identification of a specific animal, recognizing and deterniining the 
position of an animal or a specific part of it, or physical characteristics of an animal 

10 defining its economic value, have been developed, and are disclosed, for example, 
in the following patents. 

U.S. Patent No, 5,412,420 discloses a technique for measuring three- 
dimensional (3D) phenotypic characteristics of dairy cows. A 3D image is created 
by projecting several laser light beams and measuring their reflections with a single 

15 laser camera that scans a surface area of the animal and measures the distance at 
each point between the camera and the surface of the animal. By this, a total 
modeling of the animars surface is provided. The camera generates a detailed map 
of the entire animal within the scanned space, assigning intensity and range values 
to each surface point that receives a laser signal. The obtained image is then 

20 analyzed by linear, angular or volumetric means. There are ciirrently 15 
conformation traits that are measured for Holstein Cows. After each trait is 
measured by the system, it is then converted to a scale of 1 to 50. Known as the 
rating of each trait, this conversion to a scale of 1 to 50 compares each cow 
measured to those represented within the biological extremes of the breed. 
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U.S. Patent No. 6,234,109 discloses an apparatus and method for 
recognizing and determining the position of a specific part of an animal, e.g., the 
teat of a dairy cow, to guide an animal-related device towards the determined 
position of said part. The apparatus comprises a source of structured light for 

5 illuminating a surface region to enable identification of this specific part The 
source of structured light is obtained by using a grid associated with a light- 
emitting element. The apparatus also comprises an image capture and processor 
means arranged to capture and process at least one image formed by said light, and 
control means to determine if the illuminated object includes said si>ecific part by 

10 comparing the image of the illuminated object to reference criteria defining 
different objects, and if so, to establish tiie position thereof of the illuminated 
object 

U.S. Patents Nos. 5,483,441 and 5,576,949 disclose a system for animal 
evaluation through image acquisition. According to this technique, an animal is 

1 5 evaluated to determine characteristics or traits thereof. The animal is evaluated as it 
moves through first and second scenes that correspond to different first and second 
fields of view along two essentially perpendicular lines of sight. Evaluation is 
carried out by comparing the so-obtained gray level to certain threshold values. 

U.S. Patent No. 5,398,290 discloses a system for measuring intramuscular 

20 fat in Uve cattle by an ultrasound device to produce ultrasoimd image of an interior 
muscle portion. The image contains speckles caused by the scattering of ultrasound 
waves by the intramxiscular fat. Image data representative of the speckles are 
analyzed in a computer in terms of pixel gray areas to produce a measure of 
intramuscular fat. 

25 The monitoring of body condition score (BCS) of dairy cows is. a very 

important aid in defining their herd management. The BCS is known as a herd 
technique for determining the energy balance of dairy cows to define inter alia the 
amount of food needed for a particular group of dairy cows. According tp this 
technique, an area on the cow's body in the vicinity of the tail head is inspected. 

30 This technique consists of the visual inspection of the vicinity of the tail head 
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carried out by a skilled person, who determines the dairy cow's condition and 
assigns to the specific cow a corresponding mark j&om several accepted marks. The 
results of such a manual inspection strongly depend on the experience of the 
specialist carrying out the inspection. 

5 SUMMARY OF THE INVENTION 

There is accordingly a need in the art to facilitate the automatic monitoring 
of the body condition, by providing a novel imaging method and system. 

The main idea of the present invention consists of imaging a region of 
interest on the body to obtain a tiiree-dimensional representation of the region of 

10 interest, and analyzing the three-dimensional representation to determine data 
indicative of the curvature (surface reUef) of this region and utilize certain 
reference data to determine the body condition. This can be implemented by 
determining, from the 3D representation of the region of interest, a predetermined 
measurable parameter indicative of the curvature of the region of interest Then, 

15 previously prepared reference data representative of the body condition scales and 
corresponding values of the predetermined measurable parameter can be used to 
analyze the determined value of this parameter for the specific imaged body and 
estimate the corresponding value of the body condition scale. 

The term ''curvature*' signifies data indicative of a topographic map 

20 (surface relieJ^ of the region of interest, and is actually representative of the surface 
defined by the volxune (depth) of the region of interest Preferably, the curvature is 
determined with respect to a predefined plane (reference plane) tangential to the 
region of interest. Considering monitoring the body condition score (BCS) of dairy 
cows, the region of interest includes the dorsal and/or the rear part of the cow in the 

25 vicinity of its tail head, and the reference plane is preferably tangential to the dorsal 
and/or the rear part of the cow at the point of both pins bones and tail. 

The technique of the present invention is useful for estimating the current 
and the tendency of the energy balance of an animal (to thereby enable 
appropriately adjusting nutrition of the specific animal) and for determining 
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irregularity in the locomotion and coordination patterns of an animal (which is 
indicative of a disease), as well as for modeling a body part (human or animal 
body), 

There is thus provided according to one aspect of the present invention, an 
5 imaging method for use in automatic monitoring the body condition of an animal, 
the method comprising: 

(i) imaging a predetermined region of interest on the animal body, and 
generatmg data indicative thereof; 

(ii) processing the generated data to obtain a three-dimensional representation 
10 of the region of interest; 

(iii) analyzing said three-dimensional representation to determine a 
predetermined measurable parameter indicative of a surface relief of the 
region of interest indicative of the body condition of the imaged animal. 
According to another aspect of the invention, there is provided a method for 

15 optimizing nutrition of an animal, the method comprising automatically monitoring 
the energy balance of the emimal, said monitoring comprising: 

i) imaging a predetermined region of interest on the animal body, and 
generating data indicative thereof; 

ii) processing the generated data to obtain a tbree-dimensional representation 
20 of the region of interest; 

iii) analyzing said three-dimensional representation to detemaine a 
predetermined measurable parameter indicative of a surface relief of the 
region of interest indicative of the energy condition of the animal. 

The imaging includes acquiring one or more image of the region of interest 
25 by illuminating the region of interest with structured light (i.e., one- or two- 
dimensional array of spatially separated light components) and collecting light 
scattered from the illuminated regions. The image is then processed to calculate the 
predetermined measxirable parameter indicative of the curvature (surface relief) of 
the region of interest, and utilize certain reference data to determine a value of body 
30 condition corresponding to the calculated value of the predetermined parameter. 
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The reference data is previously prepared by applying measurements with both the 
conventional and inventive technique to animals, and is representative of the body 
condition scedes (values) and corresponding values of the predetermined 
measurable parameter. 

The image acquisition may be carried out by one or two pixel-array 
detectors. Preferably, a video camera is used for sequentially acquiring a plurality 
of images. Preferably, the images are acquired dxiring a relative displacement 
between the animal and camera, e.g., the animal moves along a predefined path. 

The measurable parameter indicative of the curvature of the region of 
interest may be at least one of the following: a distance (height) of the extreme 
point in the topographic map (deterniined as a distance betwe^ the reference plane 
and a point in the region of interest mostly distant from the reference plane); the 
area of a cross-section of the topographic map in a plane perpendicular to the 
reference plane (surface area defined by the illuminated surface regions in the plane 
perpendicular to the reference plane) and including the extreme point in the map; 
and at least a part of the volume, (depth) defined by at least a predetermined region 
of the topographic map (illuminated sxjrface regions) with respect to the reference 
plane. 

According to another aspect of the present invention, there is provided an 
imaging method for use in automatic monitoring the body condition score (BCS) of 
a dairy cow, the method comprising: 

(i) imaging a region of interest including at least one of the dorsal part or the 
rear part of the cow in the vicinity of its tail head, and generating data 
indicative thereof; 

(ii) processing the generated data to obtain a three-dimensional representation 
of the region of interest; 

(iii) analyzing said three-dimensional representation to determine a 
predetermined measurable parameter indicative of a surface relief of the 
region of interest indicative of the BCS of the imaged cow. 
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According to yet another aspect of the present invention, there is provided a 
method for monitoring the body condition of an animal, the method comprising: 

providing reference data representative of the body condition scales and 
corresponding values of a predetermined measurable parameter indicative of 

5 the curvature of a region of interest on the body; 

imaging the region of interest by illuminating an array of spaced-apart 
locations on the body vs^ithin the region of interest, collecting light returned 
from the illuminated locations, and generating data indicative thereof; 
processing said generated data to obtain a three-dimensional representation 

10 of the region of interest and C2ilculate a value of the predetermined 

measurable parameter from said three-dimensional representation; and 
utilizing said reference data to determine the body condition scale 
corresponding to the calculated value of said predetOTnined measurable 
parameter. 

15 According to yet another aspect of the present invention, there is provided a 

method for monitoring the body condition score (BCS) of a dairy cow, the method 
comprising: 

- providing reference data representative of the BCS scales and corresponding 
values of a predetermined measurable parameter indicative of the curvature 
20 of a region of interest including at least one of the dorsal part and the rear 

part of the cow in the vicinity of its tail head; 

imaging the region of mterest by illuminating an array of spaced-apart 
locations on the cow body within the region of interest, collecting light 
returned from the illuminated regions, and generating data indicative 

25 thereof; 

processing said generated data to obtain a three-dimensional representation 
of the region of interest and calculate a value of the predetermined 
measurable parameter from said three-dhnensional representation; and 
utilizing said reference data to determine the BCS scale corresponding to the 

30 calculated value of said predetermined measurable parameter. 
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The processing of the data indicative of the acquired image includes 
detennining a shift of the location of each of tiie illuminated locations on the 
surface of the body caused by the curvature of the surface. If a single image is 
acquired, such a shift is a distance between the actual position of the illuminated 
5 location on the curved surface and corresponding location along the trajectory of 
the corresponding light component (i.e., a theoretical location of the corresponding 
location on the surface, if the surface were substantially flat). If two images are 
acquired with diflferent angles of collection of light returned from the region of 
interest, the shift is a distance between positions of the two illuminated locations of 
10 a matching pair of locations in the two images (Paralax). To this end, the processing 
preferably includes determining the central points of all tiie illuminated locations. 
The shift is indicative of the height of the respective point in the map (3D 
representation), and is determined utilizing data indicative of the detectors' location 
with respect to each other and relative to the region of interest, or the single 
15 detector's location relative to the region of interest and to the trajectories of the 
' incident light components. 

According to yet another aspect of the invention, there is provided a method 
for monitoring the condition of an animal, the method comprising: 

imaging the cow while marching along a predetemiined path and generating 
20 data indicative of the acquired images; 

analyzing said data to identify the existence of a certain pattem of 
locomotion or in-coordination in the cow's marching. 

The technique of the present invention can thus be used to determine the 
existence of in coordination, locomotion and some neurological disorders 
25 associated with nervous system diseases, such as: the "mad cow" disease, CCN 
(Cerebrocortical necrosis), tumors, parasitoses, meningitis, rabies, trauma, 
compression and intoxicoses of the animal. 

According to yet another aspect of the invention, there is provided an 
imaging method for use in automatic monitoring the body condition score (BCS) of 
30 a dairy cow, the method comprising: 
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imaging a first region of interest on the cow's body in the vicinity of the 

waist part of the cow and a second region of interest on the cow's body in 

the vicinity of its tail part, and generating imaged data; 

processing the imaged data to obtain a three-dimensional representation of 

the first region of interest and tiie second region of interest; 

ansdyzing the three-dimensional representation to determine a predetermined 

measxjrable parameter indicative of a surface relief of the region of interest, 

thereby determining first and second BCS values for the first and second 

regions of interest, respectively, a difference between the first and second 

BCS values being indicative of a tendency in the cow energy balance 

condition. 

The waist part of the cow's body is of interest because it is indicative of the 
transverse processes of the lumbar vertebrae and the spinous processes of the 
lumbar vertebrae. For example, the BCS values of 3.2 and 3.1 measured at, 
respectively, the first region of interest (transverse processes of the lumbar 
vertebrae and the spinous processes of the lumbar vertebrae) and the second region 
of interest (the tail-part of the cow) are indicative of liiat the cow is in accumulating 
surplus of the energy balance, and vice versa^ if the BCS values of 3.1 and 3.2 are 
measured at, respectively, tibe first and second regions of interest, this is indicative 
of that the cow is in accumxilating deficit of the energy balance. 

According to yet another aspect of the present invention, there is provided a 
system for monitoring the body condition of an animal, the system comprising: 
(a) an optical device including an illuminating assembly operable to produce 
structured light in the form of an array of spatially separated light 
components to thereby illuminate an array of locations within a 
predetermined region of interest on the body part, and a light detection 
assembly operable for acquiring at least one image of the illuminated body 
part by collecting light scattered therefirom and generating data indicative of 
the acquired image; 
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(b) a control unit connectable to the optical device, the control xinit comprising a 
memory for storing reference data representative of the body condition 
scales and corresponding values of a predetermined measurable parameter 
that is indicative of the surface relief of the predetermined region of interest 
5 of the body part; arid a data processing and analyzing utility preprogranmied 

for processing the data indicative of the acquired image to obtain a three- 
dimensional representation of the imaged region, calculate a value of the 
measurable parameter for the imaged body part, and analyze the calculated 
value with respect to the reference data to thereby determine the body 
10 condition scale of the ^ecific animal. 

According to yet another aspect of the present invention, tiiere is provided a 

system for monitoring the body condition score (BCS) of a dairy cow, the system 

comprising: 

(a) an optical device including an illuminating assembly operable to produce 
15 structured light in the form of an array of spatially separated light 

components to thereby illuminate an array of locations within a 
predetermined region of interest on a body part of the dairy cow, and a light 
detection assembly operable for acquiring at least one image of the 
illuminated body part by collecting light scattered therefrom and generating 
20 data indicative of the acquired image; 

(b) a control tmit coimectable to the optical device, the control unit comprising a 
memory for storing reference data representative of the BCS scales and 
corresponding values of a predetermined measurable parameter that is 
indicative of the surface relief of the predetermined region of interest 

25 including at least one of the foUowiag body parts: the rear part of the cow in 

the vicinity of its tail head and at least one dorsal part of the cow; and a data 
processing and analyzing utility preprogranmied for processing the data 
indicative of the acquired image to obtain a three-dimensional representation 
of the region of interest and calculate a value of the measurable parameter 

30 for the specific imaged cow, and analyze the calculated value with respect to 
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the reference data to thereby determine the BCS scale of the specific dairy 
cow. 

The illuminating assembly may have one of the following configuration: It 

may be composed of a single light emitting element and a mask formed with an 
5 array of spaced-apart light transmitting regions spaced by light blocking regions; 

may be formed by an array of spaced-apart light emitting elements (lasers); may be 

a scanner, namely a light source (e.g. laser) that moves rapidly and scans the area; 

may be composed of one or more linear light sources or line scan; or may include a 

diffraction mask that creates a pattern. 
10 More specifically, the present invention is used for determining the BCS of 

dairy cows aimed at optimizing the cows' nutrition and is therefore described below 

with respect to this specific application. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In order to understand the invention and to see how it may be carried out in 
15 practice, preferred embodiments will now be described, by way of non-limiting 
example only with reference to the accompanying drawings, in which: 

Fig. 1 is a schematic illustration of the main components of the imaging 
system according to the present invention; 

Figs. 2A to 2C illustrate three different examples, respectively, of an 
20 illiiminating assembly suitable to be used in the system of Fig. 1 ; 

Fig. 3A schematically illustrates the region of interest on the body part of 
the dairy cow illuminated by the illuminating assembly of either one of Figs. 2B 
and 2C; 

Fig. 3B illustrates the experiment of imaging the region of interest with the 
25 illuminating assembly of Fig. 2A; 

Fig. 4 is a flow diagram of the main operational steps in a method according 
to the invention; 

Figs. 5A-5C exemplify the principles of calculation of a specific measurable 
parameter indicative of the curvature of the region of interest; 
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Fig. 5D schematically illustrates the spots' pattern on the dorsal and/or the 
rear part of a cow; and 

Fig. 6 is a flow diagram of the image processing steps according to one 
embodiment of the invention utilizing acquisition of two images with different light 
5 collection angles. 

DETAILED DESCRIPTION OF THE INVENTION 

Referring to Fig. 1, there is schematically illustrated an imaging system 100 
according to the invention for determining the BCS of a dairy cow DC. The cow is 
typically provided with an identification code carrying tag (not shown) attached, for 

10 example, to its leg (e.g., front leg), neck, ear or any other place. The imaging 
system 100 includes an optical device 102 and a control unit 110. 

The optical device 102 includes an illxmiinating assembly 104 and a 
detection assembly 105. The detection assembly 105 includes a pixel-array detector 
106, which is preferably a video camera, and may optionally include an additional 

15 pixel-array detector 108 (shown in dashed lines). The illuminating assembly 104 is 
constructed and operated to produce structured light in the form of an array (one- or 
two-dimensional array) of light components, as will be described more specifically 
fiirther below with reference to Figs. 2A-2C. The camera(s) 106 is accommodated 
and oriented with respect to the body (a site where the body is to be located during 

20 the monitoring procedure) so as to acquire images of a predetermined region of 
interest. If more than one detector is used, the detectors are oriented with respect to 
the cow-containing site so as to acquire images of substantially the same region of 
interest but with different angles of light collection, respectively. The output of the 
camera(s) is connectable to the control unit 110. The control unit is typically a 

25 computer system (preferably preprogrammed to be the so-called ''expert system") 
having a memory utility llOA for storing inter alia predetermined reference data, a 
data processmg and analyzing utility llOB, as well as an input interface HOC, data 
output utility HOD (display), etc. 
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For the purposes of the present invention, in this specific example of 
monitoring the BCS of a dairy cow, the region of interest to be imaged includes the 
dorsal part of the cow and/or the rear part of a dairy cow in the vicinity of the cow's 
tail head 114. Hence, the illiiminating assembly 104 is oriented with respect to the 
cow-containing site so as to be placed behind and above the respective body part. 
Preferably, an additional region of interest to be imaged, for the purposes described 
further below, is a waist part of the cow 114A including the transverse processes of 
the lumbar vertebrae and the spinous processes of the lumbar vertebrae. 

Figs. 2 A - 2C illxistrate three non-limiting examples of the implementation 
of tiie illiiminating assembly 104. In the example of Fig. 2A, the illxmiinating 
assembly 104 includes one-dimensional array of light-emitting elements, (e.g. 
lasers that are operable to produce an array of jqjatially separated light beams, 
generally at 112A to thereby illuminate an array of spaced-apart locations (e.g., 
spots) within a region of interest. The illuminating assembly is the so-called "laser 
beam box", for example producing 40 laser beams with the beam axes being for 
example spaced a 2cm distance from each other. The box 104 at its front surface 
(by which it faces the cow) is formed with an optical window 107 (e.g., glass 
window). A power supply of 4.5V and 500mA is can be used. In the example of 
Fig. 2B, the illuminating assembly 104 is composed of a two-dimensional array of 
ligjit-emitting elements, e.g. lasers, generally at 104A, each operable to produce a 
light beam 112A, to thereby illuminate a matrix (two-dimensional array) of spaced- 
apart locations (e.g., spots) within a region of interest. 

In the example of Fig, 2C, the illuminating assembly 104 comprises a single 
light emitting element 104B generating a beam of light 113, and a mask (grid) 116 
in the form of an array (one-dimensional array, or two-dimensional array as shown 
in the present example) of transmitting regions (e.g., holes) 118 spaced by non- 
transparent (blocking) regions. Hence, the mask (grid) 116 splits the emitted light 
beam 113 into a two-dimensional array of spatially separated light components 
112B to thereby produce a two-dimensional array of spaced-apart illuminated 
locations within the region of interest. Generally speaking, the light components 
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produced either by the array of light-emitting elements 104A or by the array of 
holes 118, are arranged in a pre-defined pattern, e.g., a matrix shape, e.g., 
consisting of straight lines and rows. 

Fig. 3A schematically illustrates the rear part of the cow (one example of the 

5 suitable region of interest) with a matrix of illuminated locations (spots) 120 
covering the entire imaged area. Fig. 3B illustrates the experiment of imaging the 
region of interest with one-dimensional array of light beams: shift of the 
illuminated spots' locations firom those obtainable on a flat surface is associated 
with the curvature of the imaged si^rface. 

10 The main relevant parts for the scoring of the cow are the pins bone (Tuber 

ischii), the hooks bone (Tuber coaxe), tiie thurl and the sacral ligament. The central 
area of the illuminated body part along the tail head is typically convex, while the 
regions at both sides of the tail head may be convex, flat, or concave. The degree of 
concavity of these regions is correlated with the body condition of a cow. 

15 According to the conventional technique, a skilled person (veterinary) inspects the 
rear part of the cow visually, and sometimes with manually appreciation, to 
estimate the degree of concavity and/or convexity of the relevant areas and 
' determine the BCS of the cow, that defines the sub cutaneus amoimt of adiposic 
tissue which indicates the energy balance of the cow. 

20 In order to enable automatic determination of the BCS of dairy cows, the 

present invention uses the imaging system of Fig. 1 (with one or two cameras) and 
a specific image processing technique. As indicated above, the detection assembly 
preferably includes a video camera, operable to acquire 25 firames per second. The 
camera may be conventional industrial color video camera (e.g., 5x5x1 0cm) 

25 equipped with appropriate focusing optics, aperture, shutter and speed and white 
balance means. 

Initially, the required orientation between tiie system elements (the 
illuminator and the detector(s)) and the cow location or the cow movement path is 
provided. In general, images of the dorsal and/or the rear part of the cow are taken 
30 from up and behind the cow, at predetermined elevation angle(s), for example 
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raaging between 45"* and 90"*- If the camera is mounted at an angle other than the 
desired angle, the image is &st transformed to meet this requirement, for 
uniformity purpose. This transformation may for example be a rotational 
transformation or a multiplication of rotational transformations that rotate the plane 
5 of image in the desired direction. For example, a suitable matrix (realizing the 
rotational transformation) multiplies the vector of points representing the spots of 
the image, to give the resulted vector, which represents the rotated plane, i.e., the 
rotated image. 

Considering a single vide camera, it is preferably positioned at a 90 degree 

10 elevation and at a 145cm distance from the cow back height to achieve a focused 
image (the laser line being in the middle of the image frame). The camera is 
calibrated once during the installation. The focus is set to an average distance of the 
cow back. The exposure is set to maintain a contrast between the laser spots and the 
brightest possible area on the dark area. The camera calibration stage includes the 

15 following two steps: acquiring a set of images at predetermined distances, and 
storing the images (in the memory utility of the control xinit); processing the images 
to detect the laser spots; calibrating the processing (software model), to create a 
depth of focus to thereby give the desired precision of measurements of the surface 
profile depth (with about 1mm tolerance). The determined depth of the spots' 

20 locations is then translated to a three-dimensional curve. 

As shown in Fig. 4, the main operational steps of the S3^em are as follows. 
The optical device (illuminating assembly 104 and detection assembly 105 shown 
in Fig. 1) is operated to obtain data indicative of one or more images of the region 
of interest (step A). This is implemented by illuminating an array (one- or two- 

25 dimensional array) of locations within the region of interest on the cow*s body, 
collecting light returned (scattered) from the region of interest by one or two 
cameras, and generating output indicative of the so-acquired images. This output 
data is received at the control unit 110 and processed by the data processing and 
analyzing utility (software) appropriately preprogrammed (e.g., with real time 

30 grabbing software with an event indicator whenever a new frame is grabbed) to 
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control the imaging process and obtain three-dimensional representation of the 
body surface within the region of interest (step B), and further process the 3D 
representation to determine the BCS of the imaged cow (step C). This is 
implemented by calculating a value of a predetermined measurable parameto: 
5 indicative of the curvature (surface relief) of the region of interest and utilizing 
previously prepared (and stored in the memory of the control imit) reference data in 
the form of BCS scales and corresponding values of the predetermined measurable 
parameter to analyze the calculated value and determine the corresponding BCS 
scale. 

10 Generally speakings in order to calculate the measurable parameter 

indicative of the curvature of the region of interest, a shift between the two images 
for each of the illuminated locations (spots) on the surface of the cow's body 
caused by the curvature of the surface is determined. If a single image is acquired, 
such a shift is a distance between the actual position of the illuminated location 

15 with respect to the other locations and a 'theoretical" position of the corresponding 
location on the surface if being substantially flat (i.e., the corresponding location on 
the body surface along the trajectory of the corresponding light component). If two 
images are acquired by two detectors, respectively (or by the same detector but at 
different relative locations with respect to the region of interest, e.g., during the 

20 cow's movement with respect to the detector), this shift is determined as a distance 
between the two illuminated locations of a matching pair in the two images. The 
shift is indicative of the height of the respective point in the topography map (three- 
dimensional representation of the region of interest), which is determined by 
utilizing data indicative of the detectors* location with respect to each other and 

25 relative to the region of interest, or the single detector location relative to the region 
of interest and to the illuminator trajectory. 

The measurable parameter is indicative of the curvature of the region of 
interest, i.e., of a topographic map (surface relief) of the region of interest, and is 
actually representative of the volume (depth) of the region of interest. This 

30 curvature is determined with respect to a predefined reference plane (RP in Fig. 1), 
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which in the present example is perpendicular to the line between the camera and 
the cow's rear part and is tangential to the region of interest, namely, to the dorsal 
and/or the rear part of the cow at the point of spin bone and tail head. Generally, the 
reference plane is selected as a plane in the vicinity of the tail head. 

Preferably, the system of the present invention is installed at a 
predetermined location for monitoring the dairy cow condition when passing along 
a predetermined (substantially straight) path. As indicated above, the cow is 
assigned with unique identification code that is presented on a tag attached to the 
cow. Such an ID tag may be optical (barcode), RF tag (carrying an RF resonance 
circuit), magnetic tag or of any other automatic ID technique. The construction and 
operation of the tag do not form part of the invention. Such a tag may be of any 
known suitable type, and therefore need not be specifically described, except to 
note that it is preferably attached to a predetermined location on the cow, for 
example tiie firont leg of the cow. When the cow moves along the predetermined 
path and its front leg arrives at a location of the ID reader accommodation, the cow 
is identified and a respective signal is generated (by the ID reader) to actu-ate the 
imaging system either immediately or a certain time thereafter, depending on a 
distance between the ID-location and the region of interest and a prediction of the 
cow movement speed. It should be understood that alternatively or additionally, the 
imaging system or at least its optics is movable Avith respect to the cow location. It 
should also be understood that that the system of the present invention may utilize a 
remote control unit that may be wireless connected to the optical device. The 
system may operate to grab the required number of images and transmit data 
indicative of the images as weU as data iadicative of the cow^s ID to a remote 
(central) location where the data is appropriately processed. 

Preferably, a sequence of images of tiie moving cow is acquired so as to 
thereby identify an in-coordination or locomotion problem of the cow marching. 
The existence of a certain pattern of this locomotion and/or in-coordination 
problem is indicative of a certain problem (disease), for example is indicative of 
limping, neurological disorder associated with nervous system diseases, such as 
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"mad cow" disease, CCN (Cerebrocortical necrosis), tumors, parasitoses, 
meningitis, rabies, trauma, compression and intoxicoses of the animal.. 

As indicated above, another region of interest for monitoring the BCS of 
dairy cow is the part of the cow. It has been found that a difference between the 

5 BCS values measured at the transverse processes of the lumbar vertebrae and the 
spinous processes of the lumbar vertebrae and tail-parts of the cow is indicative of 
the tendency in the cow energy balance condition thereof. For example, the BCS 
values of 3.2 and 3.1 measured at, respectively, the transverse processes of the 
lumbar vertebrae and the spinous processes of the lumbar vertebrae, and the tail- 

10 part of the cow are indicative of that the cow is in accumulating stirplus of the 
energy balance, and vice versa^ if the BCS values of 3.1 and 3.2 are measured at, 
respectively, the transverse processes of the lumbar vertebrae and the spinous 
processes of tiie lumbar vertebrae the and tail-part of the cow, this is indicative of 
that the cow is in accumulating deficit of the energy balance. 

15 Figs. 5A-5C exemplify the determination of the measurable parameter 

according to the technique of the present invention. 

Fig. 5A shows a 3D topography map TP reconstmcted from the map(s) of 
points grabbed by one or two cameras from the region of interest (back of the cow). 
These points correspond to the scattering of the illuminated locations produced by 

20 the structured incident light. For example, a matrix of 120 laser sources can be used 
as the illiominating assembly. As shown in Fig. SB, the measurable parameter may 
be a distance h (height) between the reference plane RP and the point Pi in the 
topography map mostly distant from the reference plane, or a cross-sectional area 
CA of a cross-sectioned segment ES of the map in a plane P* perpendicular to the 

25 reference plane and defined by a pah of most distant points Pi and P2 at opposite 
sides of the central plane of the image. Such a measurable parameter may be a 
volume V (depth) of at least a part of the topography map shown in Fig. 5 A. The 
topography map is composed of a pluraUty of height levels defining contours of 
constant height levels (C1-C5) in the 2D representation of the 3D-topography map, 

30 shown in Fig. 5C. An arrow B represents the tail head, which is typically an axis of 
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symmetry of the image of the structured Ught. Points A and C are the end points in 
the 2D image along an envelope segment passing through the two points Pj and P2, 
which were defined above. Thus, there are several techniques for calculating the 
measurable parameter indicative of the curvature (tiie so-called Curvature Factor 

5 Measure or CFM). According to one technique, this parameter is the distance 
between the reference plane RP and the point on the line-segment ES maximally 
distant from the reference plane RP. According to another technique, this 
parameter is the cross-sectional area CA confmed between the envelope segment 
ES and its projection on the reference plane AC. Preferably, the measurable 

10 parameter is the volume of at least a part of the topography map confined between 
title envelope segment, wherein the relevant part of the topography map is defined 
by a rectangle of a certain area (the entire structured light grid LG or a part of it) 
around the line segment ES, and the projection of this area onto the reference 
plane. This calculation practically comprises the integration of the height values of 

15 the illuminated locations (centers of these locations) over the image within the 
certain area, or, equivalently, sxraiming the distances between the envelope segment 
and the reference plane over aU the center points of the illuminated locations within 
the certain area. This can be written as: 

20 CFM = T.iP{UJ)-'^tfiUj))xAreaUnit 

fj 

wherein P(i, j) - Ref(i, j) is the height difference value between the envelope 
segment and the reference plane at point (i, j), and AreaUnit is the mean area 
around one illuminated location (spot) in the structured light matrix, or more 
25 precisely, the square of the mean distance between the centers of the neighboring 
illuminated spots in the structured light matrix. Hence, the CFM value may be 
given in volume units, e.g. cubic centimeters (cm^). 

The accuracy in calculating the centers of the illvmiinated locations is 
estimated to be about a tenth of a pixel. The accuracy in height is estimated to be 
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about 1/2000 of the field-of-view of the camera, which for a measured volume of 
600inm*600mm*600mm is about O.Smm, less than the expected error due to the 
fur of a cow. The maximal e>q>ected depth of concavity is about 150mm. If the BCS 
value should be calculated with accuracy of 0.25, there are 16 different values 
5 between BCS 1 and 5. Thus, accuracy in height of 150mm/16 or 9375nrai is 
sufiBcient for the purposes of the present invention. The estimated accuracy is 5 
times better. The system today deals with the following 13 BCS scale values: 1.00, 
1.50, 2.00, 2.25, 2.50, 2.75, 3.00, 3.25, 3.50, 3.75, 4.00, 4.50, and 5.00. With the 
accuracy of 1 decimal score (0.1), 50 BCS scales can be achieved (1.00, 1.10, 

10 1.20, 4.80,4.90,5.00). 

Fig, 5D schematically illustrates the spots' pattern on the rear part of a cow. 
It should be understood that, actually, imaging and analyzing the surface relief at 
one side of the cow's tail is sufiBcient for the purposes of the present invention. 

The rear part of a cow may comprise deep valleys (for thin cows of low 

15 BCS) or shallow valleys, or may have no valleys at all (for normal cows with 
moderate BCS). Accordingly, the CFM can be positive, zero or negative. The 
inventors have found that for cows with BCS of about 3.50, the value of CFM is 
about zero. Thus, for cows of the BCS below 3.50 the value of CFM is negative, 
while cows of BCS above 3.50 have a positive value of CFM. 

20 Using reference data in the form of a large set of scans of cows of known 

BCS values enables to calculate the CFM values resulting from the image 
processing for each scan and match it with the given BCS value. Hence, a 
correlation between CFM and BCS values can be determined. This correlation is 
not necessarily a linear transformation and might not even be represented by any 

25 mathematical formula at all, but is simply experimentally matched. In such a case, 
the match is represented in a table correlating between pairs of points, where the 
first point is a CFM value, and the other point is a BCS value. 

Reference is now made to Fig. 6 exemplifying a flow diagram of the 
operational stages of the unage processing considering the image acquisition with 

30 two cameras, or a single video camera. In this case, the data to be processed is 
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indicative of two images of the cow's rear part concurrently acquired by two 
cameras with two different angles of light collection. 

Initially, a calibration stage is carried out, in order to compensate for internal 
variables of the camera(s) and for external variables of the camera(s) (step I). Such 
internal variables include magnification, calibration and Distortion, while extemal 
variables of the cameras are for example the relative angles of the cameras in space. 

Then, calibration of the centers of all illuminated locations is carried out by 
suitable image processing (e.g., including pattern recognition) - step H, The spot's 
center can be identified as the brightest point or gravity center in the spot When 
operating with two cameras, processing of data received fi:om the two cameras 
includes finding the matching pairs of illuminated locations, i.e., two images of the 
same illunoinated location. Since such an iUunmiated location is practically not a 
point-like location, but a spot, elongated region, line, etc., the processing starts with 
finding the center of each of the illuminated locations in each of the two images. 
For light spots, the center is simply the geometrical center of each spot. The finding 
of the center can be done by any known suitable method, for example by detecting 
extreme locations of the illuminated region along two mutually perpendicular axes 
and calculating the center of the so-formed geometrical structure. For lines, the 
central point is defined as the point of maximal light intensity along the illuminated 
line. Then (considering the operation with two cameras), matching pairs between 
the central points of the illuminated locations in the two images are determined, 
i.e., location of each illuminated spot in the first image is matched with the 
corresponding location in the second image (step HI). In general, imaging of a flat 
surface, e.g. a flat wall, using a matrix of illuminated spots would result in an 
image composed of a matrix of spots with the same pattern as that of the matrix of 
incident light components, e.g., a two-dimensional linear array. When illimiinating 
the dorsal and/or the rear part of a cow, which is a curved surface, the locations of 
some of the spofs are shifted firom those in the flat-surface image, due to the surface 
curvature. Moreover, some of these spots, e.g. at places of extreme curvature, 
where one spot may coincide with another spot, may not appear in the image at all. 
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Hence, there can be unmatched spots in the two images, but it should be understood 
tiiat the matched spot in one image is always associated with a single spot in the 
other image. It should be understood tiiat when operating with the single video 
camera, this step III is elininated. 

5 At a further step (step IV), 3D coordinates of each illuminated location on 

the cow's surface are calculated, utilizing the data representative of the spots' 
centers location (or, in the case of two cameras, data representative of the two- 
dimensional coordinates of the pairs of central points of the matched illuminated 
locations) and data representative of the three-dimensional (3D) location of the 

10 camera(s). This can be done by the triangulation method. The principles of this 
technique are know per se^ and therefore need not be described in detail, except to 
note the following. The triangulation technique is based on measuring a shift 
(called parallax) of an imaged object in two images. More specijBcally, when the 
object is imaged by two cameras distanced from each other (or by one camera 

15 taking two different shots at two places far apart), the relative place of the object is 
shifted between the two images, i.e., the object's image changes its location relative 
to the background. Measuring this shift allows for determining the distance of the 
object from the background or from the camera(s), or finds its location in space. By 
this, the 3D locations of all the illuminated spots within the region of interest are 

20 calculated, assuming that the peripheral illuminated spots may serve as the 
background for tiie calculation in the first approximation. If the peripheral 
illuminated spots are not shifted due to the surface curvature, or if such a shift is 
negligible, the use of a single camera is sufficient to calculate the deviation of each 
of the interior illuminated spots from its assumed position in the absence of the 

25 surface curvature. This shift, together with the relative locations of the camera and 
the light source from the region of interest, enable to calculate the "height" of each 
illuminated spot with respect to an imaging plane. When the single video camera is 
used, each point depth is calculated by measuring the distance between this point 
and a straight reference line between the tow pins bone (Tuber ischii), as shown in 
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Fig. 5D. To this end, one-side measuring is sufficient, or when having data from 
both sides, the highest side is taking into account. 

The so-obtained 3D coordinates are then used to calculate Curvature Factor 
Measure (CFM) indicative of the cow's body condition score - step V. To this end, a 

5 two-dimensional (2D) representation of the 3D cow's rear part is obtained, for 
example in the following manner. First, the reference plane RP is selected. Then, 
the points calculated in the previous stage are drawn on the selected reference 
plane. In order to do so, then: coordinates may need to be transformed according to 
the coordinate system of the chosen plane. The first two coordinates of each point 

10 (Xi, Yi) represent its place within the reference plane RP, while the third coordinate 
(Zi) denotes the height of the point above/beneath the reference plane RP. This data 
indicative of the points* heights is used to calculate the CFM. The 3D virtual 
surface is thus the basic for the CFM measurements. The BCS is then obtained 
from the calculated CFM value and the reference data, as described above (step 

15 VI). 

It should be understood, that in the case of a single camera, the image 
processing is generally similar to that of two cameras, and differs therefrom in the 
following two modifications, (a) Finding of matching pairs of points (centers of the 
illuminated spots) is eliminated since there is a single image; and (b) Calculation of 

20 the 3D location of a given illuminated spot on the cow's body part is carried out by 
taking into account the location of the light source and the direction of the light 
beam from the light source to the relevant light spot along the trajectory of the 
beam. These modifications actually affect the determination of the shift to calculate 
the 3D location of each illuminated spot, i.e. to reconstruct the topographic map. As 

25 indicated above, the shift between the actual location of the illuminated spot and a 
'theoretical" location of the corresponding area on the surface if being substantially 
flat is determined in order to calculate the CFM. 

The system of the present invention has been tested on more than 500 dairy 
cows during three days. The tests were ftilly automated with no interference with 

30 the regular work in the cow house. The results obtained with the system of the 
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present invention were very close to those obtained manually by the ejqpert 
(veterinary), and a very high repeatability of the system operation was observed. 

Those skilled in the art will readily appreciate that various modifications and 
changes can be applied to the embodiments of the invention as hereinbefore 
5 exemplified without departing from its scope defined in and by the appended 
claims. 



